Video processing system with layered video coding for fast channel change and methods for use therewith

ABSTRACT

A video processing system includes a video encoder that encodes a video stream into a independent video layer stream and a first dependent video layer stream based on a motion vector data or grayscale and color data.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority under 35 U.S.C. 119(e) toprovisional patent application Ser. No. 61/054,746, filed May 20, 2008,which is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Technical Field of the Invention

This invention relates generally to coding used in the transmission andprocessing of video signals and devices that use such coding.

2. Description of Related Art

Communication systems provide several options for obtaining access tobroadcast video content. Consumers can receive broadcast standarddefinition and high definition television broadcasts from the air withan antenna. Analog and digital cable television networks distribute avariety of television stations in most communities on a subscriptionbasis. In addition, satellite television and new internet protocol (IP)television services provide other subscription alternatives forconsumers. Analog video signals can be coded in accordance with a numberof video standards including NTSC, PAL and SECAM. Digital video signalscan be encoded in accordance with standards such as Quicktime, (motionpicture expert group) MPEG-2, MPEG-4, or H.264. In addition to digitalcoding, some video signals are scrambled to provide access to thesesignals, only to the subscribers that have paid to access the particularcontent.

The desire for video content has driven cellular telephone networks tobegin offering video programs to their subscribers as streaming video.In this fashion, users of mobile devices can have access to videoprogramming on the go. In digital broadcast video systems, video signalsare encoded with random access points. When a user changes channels, thedecoding of the new channel can only begin after the next random accesspoint occurs. Increasing the frequency of the random access pointsincreases the encoding overhead of a video stream.

The limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of ordinary skill in the artthrough comparison of such systems with the present invention.

BRIEF SUMMARY OF THE INVENTION

The present invention is directed to apparatus and methods of operationthat are further described in the following Brief Description of theDrawings, the Detailed Description of the Invention, and the claims.Other features and advantages of the present invention will becomeapparent from the following detailed description of the invention madewith reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING(S)

FIG. 1 presents a block diagram representation of a video network 102 inaccordance with an embodiment of the present invention;

FIG. 2 presents a block diagram representation of a video processingsystem 125 in accordance with an embodiment of the present invention;

FIG. 3 presents a block diagram representation of a mobile video device110/video device 112 in accordance with an embodiment of the presentinvention;

FIG. 4 presents a block diagram representation of a video decoder 136with full decoding in accordance with an embodiment of the presentinvention;

FIG. 5 presents a block diagram representation of a video decoder 136with partial reduced decoding in accordance with an embodiment of thepresent invention;

FIG. 6 presents a block diagram representation of a video decoder 136with reduced decoding in accordance with an embodiment of the presentinvention;

FIG. 7 presents a temporal representation of the distribution of randomaccess points in independent and dependent video streams in accordancewith an embodiment of the present invention;

FIG. 8 presents a temporal representation of the distribution of randomaccess points in independent and dependent video streams in accordancewith an embodiment of the present invention;

FIG. 9 presents a block diagram representation of a video processingsystem 125′ in accordance with an embodiment of the present invention;

FIG. 10 presents a block diagram representation of a video processingsystem 125″ in accordance with an embodiment of the present invention;

FIG. 11 presents a block diagram representation of a mobile video device110/video device 112 in accordance with an embodiment of the presentinvention;

FIG. 12 presents a block diagram representation of a scrambling module160 in accordance with an embodiment of the present invention;

FIG. 13 presents a block diagram representation of a descrambling module164 in accordance with an embodiment of the present invention;

FIG. 14 presents a block diagram representation of a video processingsystem 125′″ in accordance with an embodiment of the present invention;

FIG. 15 presents a pictorial representation of a scrambled independentvideo stream 176 in accordance with an embodiment of the presentinvention;

FIG. 16 presents a block diagram representation of a video processingsystem 125′″ in accordance with another embodiment of the presentinvention;

FIG. 17 presents a pictorial representation of a descrambling of ascrambled video stream in accordance with an embodiment of the presentinvention;

FIG. 18 presents a block diagram representation of a mobile video device110/video device 112 in accordance with an embodiment of the presentinvention;

FIG. 19 presents a pictorial representation of graphics displays inaccordance with an embodiment of the present invention;

FIG. 20 presents another pictorial representation of a graphics displayin accordance with an embodiment of the present invention;

FIG. 21 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 22 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 23 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 24 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 25 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 26 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 27 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 28 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 29 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 30 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 31 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 32 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 33 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 34 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 35 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 36 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 37 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 38 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 39 is a flowchart representation of a method in accordance with thepresent invention;

FIG. 40 is a flowchart representation of a method in accordance with thepresent invention.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 presents a block diagram representation of a video network 102 inaccordance with an embodiment of the present invention. A network 102 isshown that distributes information such as video content 106 from avideo source 100 to a wireless access device 104 for wirelesstransmission to wireless video devices such as mobile video device 110and video device 112. The video content 106 can include movies,television shows, commercials or other ads, educational content,infomercials, or other program content and optionally additional dataassociated with such program content including but not limited todigital rights management data, control data, programming information,additional graphics data and other data that can be transferred inassociated with program content. Video content 106 can include videowith or without associated audio content. The video content 106 can besent as broadcast video, streaming video, video on demand and near videoon demand programming and/or other formats.

The network 102 can be a dedicated video distribution network such as adirect broadcast satellite network or cable television network thatdistributes video content 106 from a plurality of video sources,including video source 100, a plurality of wireless access devices andoptionally wired devices over a wide geographic area. In thealternative, network 102 can be a heterogeneous network that includesone or more segments of a general purpose network such as the Internet,a metropolitan area network, wide area network, local area network orother network and optionally other networks such as an Internet protocol(IP) television network.

The video content 106 can be carried as analog signals such as NationalTelevision System Committee (NTSC), Séquentiel couleur à mémoire (SECAM)or Phase Alternating Line (PAL) coded video signals, or digital videosignals such as Quicktime, (motion picture expert group) MPEG-2, MPEG-4,H.264, or other format, either standard or proprietary that are carriedvia an IP protocol such as TCP/IP, Ethernet protocol, Data Over CableService Interface Specifications (DOCSIS) protocol or other protocol.

Wireless access device 104 can include a base station or access pointthat proves video content 106 to a plurality of video subscribers over acellular network such as an Universal Mobile Telecommunications System(UMTS), enhanced data rates for GSM evolution (EDGE), 3G, 4G or othercellular data network, a wireless local area network (WLAN) such as an802.11a,b,g,n, WIMAX, or other WLAN network. In addition, the wirelessaccess device can include a home gateway, video distribution point in adedicated video distribution network or other wireless gateway forwirelessly transmitting video content 106, either alone or inassociation with other data, signals or services, to mobile video device110 and/or video device 112.

Mobile video device 110 can include a video enabled wireless telephoneor other handheld communication device that is capable of displayingvideo content. Video device 112 includes other video display devicesthat may or may not be mobile including a television coupled to awireless receiver, a computer with wireless connectivity via a wirelessdata card, wireless tuner, WLAN modem or other wireless link or devicethat alone or in combination with other devices is capable of receivingvideo content 106 from wireless access point 104 and storing and/ordisplaying the video content 106 for a user.

The video source 100, network 102, wireless access device 104, mobilevideo device 110 and/or video device 112 include one or more features ofthe present invention that will be described in greater detail inconjunction with FIGS. 2-35 that follow.

FIG. 2 presents a block diagram representation of a video processingsystem 125 in accordance with an embodiment of the present invention. Avideo processing system 125 is shown that can be used in conjunctionwith network 102 and wireless access device 104. Video processing system125 includes a video encoder 120 that encodes a video stream thatincludes video content 106, such as video signal 118 into an independentvideo layer stream 122 and one or more dependent video layer streams124. Transceiver module 128 includes a transceiver that creates RFsignals containing the independent video layer stream 122 and one ormore dependent video layer streams 124 for transmission to mobile videodevice 110 and/or video device 112. In particular, the independent videolayer stream 122 and dependent video layers streams 124 can be sent viaseparate RF channels, such as separate channels of a dual channel ormulti-input multi-output (MIMO) transceiver. In a further embodiment,the independent video layer stream 122 can be multiplexed with the oneor more dependent video layer streams 124 via time divisionmultiplexing, frequency division multiplexing, code divisionmultiplexing or via other multiple access multiplexing technique.

While shown as separate from video source 100, video encoder 120 can beincorporated into video source 100 or can be downstream of the videosource 100 in network 102. For instance, encoder 120 can be incorporatedin a head-end, video server, edge router, video distribution center, orany other network element of network 102. Transceiver 128 can beincorporated into wireless access device 104.

In an embodiment of the present invention the dependent video layerstreams 124 are encoded such that each dependent video layer stream isdependent on data from the independent video layer stream 122 fordecoding. In an embodiment of the present invention, the independentvideo layer stream 122 is encoded via MPEG-2, H.264 or other digitalcompression technique that calculates a plurality of motion vectors forframes or fields of the video signal 118. Independent video layer stream122 can be a fully encoded video stream that can be decoded inaccordance with the particular digital video format used in encodingthis video stream. However, independent video layer stream 122 includesless than the full resolution, scale or other information required fordecoding of the full data derived from video signal 118.

For example, independent video layer stream 122 includes a firstplurality of motion vector data corresponding to the plurality of motionvectors created in the encoding process performed by encoder 120, thefirst plurality of motion vector data representing a plurality of mostsignificant bits of each of the plurality of motion vectors. In thissame example, dependent video layer stream 124 includes a secondplurality of motion vector data corresponding to the plurality of motionvectors, the second plurality of motion vector data representing aplurality of least significant bits of each of the plurality of motionvectors. For instance, video encoder uses L bits to represent eachmotion vector, the N most significant bits are included in theindependent video layer stream 122 and the remaining M bits included inthe dependent video layer stream. Similarly the bits of the motionvector can be segregated into a plurality of an independent stream thatincludes the most significant bits and two or more dependent video layerstreams that include segregations of the remaining least significantbits. The independent video layer stream 122 can be decoded as normalalone, without the data from dependent video layer stream 124, but withreduced resolution motion vectors. On the other hand, the dependentvideo layer stream 124 cannot be decoded by itself because it includesonly residual motion vector data.

In a further example, the video encoder 120 can further encode the videosignal 118 into a second dependent video layer stream not expresslyshown, wherein the second dependent video layer stream includes a thirdplurality of motion vector data corresponding to the plurality of motionvectors, and wherein the second dependent video layer stream does notinclude the first plurality of motion vector data and does not includethe second plurality of motion vector data.

In a particular embodiment, the first plurality of motion vector dataincludes an integer portion for each of the plurality of motion vectorsand the second plurality of motion vector data includes a fractionalportion for each of the plurality of motion vectors. In this fashion,the independent video layer stream 122 includes the integer portion ofeach motion vector and dependent video layer stream 124 includes thefractional portion of each motion vector. In this embodiment, the fullresolution motion vectors can be decoded by forming the complete motionfrom integer portion extracted from the independent video layer stream122 and the fractional portion extracted from the dependent video layerstream 124. In addition, a reduced resolution motion vector can bedecoded from only the integer portion from the independent video layerstream. It should be noted that the dependent video layer stream 124includes only the fractional components of the motion vectors and thus,cannot be decoded by itself, without access to the integer portions ofthe motion vectors from the independent video layer stream 122.

In a further embodiment of the present invention, the independent videolayer stream 122 includes a plurality of grayscale data such as lumadata, and the dependent video layer stream 124 includes a plurality ofcolor data such as chroma data or other color data that is referenced tothe grayscale data of the independent video layer stream 122. Furtherthe dependent video layer stream 124 does not include the plurality ofgrayscale data, and the independent video layer stream 122 does notinclude the plurality of color data.

In this embodiment, the full color video can be decoded from thegrayscale data extracted from the independent video layer stream 122 andthe color data extracted from the dependent video layer stream 124. Inaddition, a grayscale video image can be decoded from only the grayscaledata from the independent video layer stream 122. It should be notedthat the dependent video layer stream 124 includes only the color datathat is referenced to the grayscale data and thus, cannot be decoded byitself, without access to the grayscale data from the independent videolayer stream 122.

It should be noted that the above examples of partial/full motion vectordata and grayscale/color layering are but are only two of many possibleways of layering video data into an independent video layer stream 122and one or more dependent video layer streams.

Video encoder 120 can be implemented in hardware, software or firmware.In particular embodiments, the video encoder 120 can be implementedusing one or more microprocessors, micro-controllers, digital signalprocessors, microcomputers, central processing units, field programmablegate arrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatessignals (analog and/or digital) based on operational instructions thatare stored in a memory module. When video encoder 120 is implementedwith two or more devices, each device can perform the same steps,processes or functions in order to provide fault tolerance orredundancy. Alternatively, the function, steps and processes performedby video encoder 120 can be split between different devices to providegreater computational speed and/or efficiency. The associated memorymodule may be a single memory device or a plurality of memory devices.Such a memory device may be a read-only memory, random access memory,volatile memory, non-volatile memory, static random access memory(SRAM), dynamic random access memory (DRAM), flash memory, cache memory,and/or any device that stores digital information. Note that when thevideo encoder 120 implements one or more of its functions via a statemachine, analog circuitry, digital circuitry, and/or logic circuitry,the memory module storing the corresponding operational instructions maybe embedded within, or external to, the circuitry comprising the statemachine, analog circuitry, digital circuitry, and/or logic circuitry.

FIG. 3 presents a block diagram representation of a mobile video device110/video device 112 in accordance with an embodiment of the presentinvention. In mobile video device 110 and/or video device 112 is shownthat includes a transceiver module 130 that receives RF signalscontaining the independent video layer stream 132 and one or moredependent video layer streams 134 and the demodulates and down convertsthese RF signals to extract the independent video layer stream 132 andthe one or more dependent video layer streams 134. Video decoder 136generates a decoded video signal 138 for video display device 140, suchas plasma display, LCD display, cathode ray tube (CRT), either directlyor via projection to create a video display for an end-user.

In an embodiment of the present invention independent video layer stream132 and one or more dependent video layer streams 134 can correspond tothe partial/full motion vector data and grayscale/color layeringdiscussion in conjunction with independent video layer stream 122 andone or more dependent video layer streams 134. In addition, independentvideo layer stream 132 can correspond to a reduced color scale, reducedresolution and/or reduced frame rate signals, and one or more dependentvideo layer streams 134 including the dependent data that is requiredfor decoding the video content 106 contained therein at full or fullerresolution.

In an embodiment of the present invention, the video decoder 136receives the independent video layer stream 132 and the one or moredependent video layer streams 134, synchronizes the independent videolayer stream 132 and the one or more dependent video layer stream 134 toform a synchronized stream, such as by combining the portions of themotion vectors, synchronizing chroma and luma data, synchronizing framesor fields, et cetera, for decoding to generate a reconstructed videosignal, in this case decoded video signal 138, based on the synchronizedstream.

As will be described in greater detail in conjunction with FIGS. 4-6,video decoder 136 optionally operates in a plurality of modes ofoperation. These modes of operation can be selected based on a deviceparameter 146 received from optional control unit 150 to conform thedecoding of the video layer streams that carry the video content 106 tothe particular characteristics or the particular state of the device.

In particular, decoder module 136 produces a decoded video signal fromat least one separate video stream chosen from the independent videolayer stream and the one or more dependent video layer streams, based onthe device parameter 146 provided by control unit 150. The deviceparameter 146 can include a device characteristic such as the deviceresolution, frame rate, color scale, black and white or color propertiesof the display device 140 that are stored in control unit 150 of themobile video device 110/video device 112. For instance, the deviceresolution of a handheld mobile device may be a reduced resolution thatcorresponds to the resolution of the independent video layer stream 132.In this case, the decoder can choose to decode only the independentvideo layer stream 132 as the at least one separate video stream whenthe device resolution corresponds to the resolution of the independentvideo layer stream 132. If however, the mobile video device 110, is afull resolution device, video decoder, receives an indication of thehigh resolution via device parameter 146 and chooses to use theindependent video layer stream 132 and each of the dependent video layerstreams 134 in decoding to create decoded video signal 138.

In a further embodiment of the present invention, the control unit 150determines the state of the device, such as a power state and passesthis information to the video decoder 136 as device parameter 146. Inthis fashion, the control unit can control the video decoder 136 to alower frame rate, lower color scale or to black and white operation, toa reduced resolution and/or to reduced motion vector resolutioncorresponding to a reduced power state that may include reducedprocessor speed and reduced computational abilities, shutting down oneor more MIMO channels of the transceiver 130 or otherwise reduce thereception bandwidth, et cetera. These changes in reception and decodingbased on the reduced power state can save processing power and helpincrease battery life.

In particular, the decoder module 136 can choose the independent videolayer stream 132 as the at least one separate video stream (the onlyvideo layer stream decoded) when the power state corresponds to a lowpower state. In addition, the decoder module 136 can choose theindependent video layer stream 132 and each of the at least onedependent video layer streams as the at least one separate video streamwhen the power state corresponds to another power state that is higherthan the low power state.

While described as a device parameter 146 that is based on acharacteristic or state of the device, more generally the video decoder136 operates in different modes of operation correspond to which, ifany, of the dependent video layer streams 134 are included in thedecoding performed by video decoder 136 to generate the decoded videosignal 138.

Video decoder 136 can be implemented in hardware, software or firmware.In particular embodiments, the video decoder 136 can be implementedusing one or more microprocessors, micro-controllers, digital signalprocessors, microcomputers, central processing units, field programmablegate arrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatessignals (analog and/or digital) based on operational instructions thatare stored in a memory module. When video decoder 136 is implementedwith two or more devices, each device can perform the same steps,processes or functions in order to provide fault tolerance orredundancy. Alternatively, the function, steps and processes performedby video decoder 136 can be split between different devices to providegreater computational speed and/or efficiency. The associated memorymodule may be a single memory device or a plurality of memory devices.Such a memory device may be a read-only memory, random access memory,volatile memory, non-volatile memory, static random access memory(SRAM), dynamic random access memory (DRAM), flash memory, cache memory,and/or any device that stores digital information. Note that when thevideo decoder 136 implements one or more of its functions via a statemachine, analog circuitry, digital circuitry, and/or logic circuitry,the memory module storing the corresponding operational instructions maybe embedded within, or external to, the circuitry comprising the statemachine, analog circuitry, digital circuitry, and/or logic circuitry.

FIG. 4 presents a block diagram representation of a video decoder 136with full decoding in accordance with an embodiment of the presentinvention. In particular, in a first mode of operation, video decoder iscoupled to receive the independent video layer stream 132 and the one ormore dependent video layer streams 134, to synchronize the independentvideo layer stream 132 and the one or more dependent video layer streams134 to form a synchronized stream and to generate a reconstructed videosignal, such as decoded video signal 138, based on the synchronizedstream. As discussed in conjunction with FIG. 2, use of all of the videolayer streams allows full decoding, such as with full resolution motionvectors, full color, full frame rate, full color scale, full resolution,et cetera.

FIG. 5 presents a block diagram representation of a video decoder 136with partial reduced decoding in accordance with an embodiment of thepresent invention. In another mode of operation, video decoder 136 iscoupled to receive the independent video layer stream 132 but less thanall of the dependent video layer streams 134. It synchronizes theindependent video layer stream 132 and the reduced set of dependentvideo layer streams 134 to form a synchronized stream and to generate areconstructed video signal, such as decoded video signal 138′, based onthe synchronized stream. This partially reduced coding could be based onless than full resolution motion vectors, less than full colorresolution, lower frame rate, lower resolution, et cetera.

FIG. 6 presents a block diagram representation of a video decoder 136with reduced decoding in accordance with an embodiment of the presentinvention. In this mode of operation, video decoder 136 is coupled toreceive the independent video layer stream 132, and to generate areconstructed video signal, in this case decoded video signal 138″,based only the independent video layer stream 132, without the dependentvideo layer stream2 134. This results in a grayscale video signal,and/or decoded video signal that is based on reduced motion vectorresolution, or other reduced video signal.

FIG. 7 presents a temporal representation of the distribution of randomaccess points in independent and dependent video streams in accordancewith an embodiment of the present invention. In particular, a videoencoder, such as video encoder 120 encodes a video stream, such as videosignal 118, into an independent video layer stream 232 and one or moredependent video layer streams 234, 234′, etc. The independent videolayer stream 232, and each of the dependent layers include a pluralityof random access points 236, 238 or 240 that can be used to begindecoding of each stream in response to a channel change or otherdisruptive event. The frequency of the random access points 236corresponding to the independent video layer stream 232 is greater tofacilitate a fast channel change or to otherwise respond more quickly toanother disruptive event. For example, random access points 238, 240 ofthe dependent layer streams 234 and 234′ can be spaced every 2 secondsand the random access points 236 of independent video layer stream 232can be spaced every 100 milliseconds, however, other periods andfrequencies, greater or lesser, can likewise be employed.

In operation, a video decoder such as video decoder 136 receives theindependent video layer stream 236 and one or more dependent video layerstreams 234, 234′ etc. after a channel change, power-up, loss of signalor other disruptive event. The video decoder generally begins operationin a first mode of operation by first encountering one of the randomaccess points 236 of the independent video layer stream 236. The videodecoder begins decoding the independent video layer stream 232 from therandom access point that it encountered and generates a reconstructedvideo signal, such as decoded video signal 138″ based on the independentvideo layer stream 232, without the dependent video layer streams 234,234′, etc. Based on the particular encoding used to generate theindependent video layer stream 232 and the dependent video layer streams234, 234′, etc. this may mean that the resulting reconstructed videosignal may initially be a basic signal of lower resolution, frame rate,color or lacking other enhancements or features as described in greaterdetail in conjunction with other embodiments that follow.

However, when the video decoder, encounters a subsequent random accesspoint 238 and/or 240 of one or more dependent video layer streams 234,234′ the decoder enters a second mode of operation where the videodecoder begins decoding these dependent video layer stream 234 and/or234′, synchronizing the independent video layer stream 232 with thedependent video layer streams 234 and/or 234′ to form a synchronizedstream, and generates a reconstructed video signal, such as decodedvideo signal 138 or 138′ based on the synchronized stream.

This configuration has the advantage that the basic video signal canbegin decoding more quickly and can be presented to the user while thedecoder waits for the random access points 238, 240 of the dependentvideo streams 234, 234′ for reconstruction of the full video signal. Inthis fashion, the user will experience a faster channel change,initiation or recovery from a disruptive event followed possibly laterby the transition from basic to the full video signal. By producing thebasic video more quickly, the user can recognize that the channel changeor recovery has begun more quickly and further can facilitate fasterchannel surfing, etc. Further, while the independent video layer stream232 has greater overhead due to the increased frequency of random accesspoints 236, the dependent video layer streams 234 and 234′ can havetheir random access points 238 and 240 spaced at greater intervals(representing lower frequencies).

FIG. 8 presents a temporal representation of the distribution of randomaccess points in independent and dependent video streams in accordancewith an embodiment of the present invention. In this embodiment of thepresent invention, the frequency of one or more of the dependent videolayer streams is lower than the random access point frequency of one ormore other dependent video layer streams. In this example, dependentvideo layer stream 234′ has a lower random access point frequency thandependent video layer stream 234.

In some circumstances, a multi-tiered decoding can occur in response toa channel change or other disruptive event. In this case, the videodecoder produces a reconstructed video signal that, at first, may bebased only the independent video layer stream, then after occurrence ofa random access point in the dependent video layer stream 234, be basedon both the independent video layer stream 232, and the dependent videolayer stream 234. Finally, upon occurrence of a random access point 240from dependent video layer stream 234′, the reconstructed video signalcan be based on the independent video layer stream 232, and each of thedependent video layer streams 234, 234′, etc.

While FIGS. 7 and 8 present examples with two dependent video layerstreams 234 and 234′, a greater or lesser number of dependent videolayers streams can be implemented in a similar fashion.

FIG. 9 presents a block diagram representation of a video processingsystem 125′ in accordance with an embodiment of the present invention.In particular video processing system 125′ include similar elements fromvideo processing system 125 that are referred to by common referencenumerals. In this embodiment, a video module 125 is included thatoperates in different modes of operation, to pass the independent videolayer stream 132 and optionally one or more of the dependent video layerstreams 134 to form at least one separate video layer stream 142. Inparticular video module 125 can pass only the independent video layerstream 132, the independent video layer stream 132 and all of thedependent video layer streams 134 or the independent video layer stream132 and only selected ones of the dependent video layer streams 134.Channel characteristics 144 and/or device parameter 146 are used byvideo module 125 to select a mode of video module 125 so that only theindependent video layer stream 132 and the necessary dependent videolayer streams 134 are sent via transceiver module 128 to mobile videodevice 110/video device 112. Video module 125 and transceiver module 128can be included in wireless access device 104. Video module 125 couldalternatively be implemented upstream of wireless access device 104 innetwork 102.

In an embodiment of the present invention, transceiver module 128transmits a video signal 139 to a remote device, such as mobile videodevice 110 or video device 112 over at least one RF channel 149 whereinthe video signal 139 is transmitted as at least one separate video layerstream 142 chosen from, an independent video layer stream 132 and amongthe one or more dependent video layer streams 134. Control module 148,coupled to the transceiver module 128 determines at least one channelcharacteristic 144 of the at least one RF channel 149 and chooses the atleast one separate video layer stream 142 based on the at least onechannel characteristic of the at least one RF channel 149.

The channel characteristic 144 can be a bit error rate, packet errorrate, signal to noise ratio, signal strength, signal to noise andinterference ratio, throughput, packet retransmission rate, a receptionparameter or other metric that describes the ability of RF channel toeffectively send the video signal 139 to the mobile video device 110 orvideo device 112. In an embodiment of the present invention, the controlmodule 148 chooses the independent video layer stream 132 as the atleast one separate video stream when the at least one channelcharacteristic 144 compares unfavorably to a threshold, transmittingonly this reduced signal when the channel characteristics call for suchan approach. Further, the control module 148 can choose the independentvideo layer stream and each of the at least one dependent video layerstreams as the at least one separate video stream when the at least onechannel characteristic compares favorably to a threshold and full scale,resolution, et cetera. video can be effectively received.

In addition, the control module 148 can select transmission parametersfor transmitting the video signal 149 based on the at least one channelcharacteristic 144 and wherein the transceiver module 128 transmits thevideo signal 149 based on the selected transmission parameters. In thisfashion, the transceiver module 128 can adjust transmission parameterssuch as modulation spectral densities, data rate, forward errorcorrection code to compensate for reduced throughput.

For example, under challenging channel conditions and reducedthroughput, the video module 125, based on channel characteristic 144,can switch to decoding only the independent video layer stream 132 anduse a lower data rate and greater forward error correcting coding toprotect this lower frame rate, lower resolution, or otherwise reducedsignal. In a further example wherein the transceiver module 128 includesa multi-input multi-output (MIMO) transceiver, and the at least one RFchannel 149 includes a plurality of MIMO channels, The transceivermodule 128 can adjust transmission parameters including adjusting aselected subset of the plurality of MIMO channels used to transmit theindependent video layer stream. In this fashion, the transceiver 128 canassign additional transceiver channels to increase the probability thatthe independent video layer stream 132 will be correctly received—sincethis video layer is required for decoding.

In addition, the control module 148 can select transmission parametersfor transceiver module 128 further based on the at least one separatevideo layer stream 142 that was chosen. Knowing the bandwidth requiredand particular signals to be transmitted, based on the control module'sown analysis of the channel characteristics 144, can help the controlmodule 148 select and/or assign MIMO channels, modulation spectraldensities, data rate, forward error correction code and othertransmission parameters.

In a further embodiment of the present invention, transceiver module 128receives a device parameter 146 from a remote device, such as the mobilevideo device 110 or video device 112 and transmits video signal 139 asat least one separate video layer stream 142 chosen from, independentvideo layer stream 132 and one or more dependent video layer streams134. Control module 148 chooses the at least one separate video layerstream 142 based on the device parameter 146. In this fashion, controlmodule 146 chooses the independent video layer stream and only thosedependent video layer streams for decoding and transmission that arerequired based on the characteristics and state of the mobile videodevice 110 or video device 112.

For example, the device parameter 146 can include a device resolutionand the control module can choose the independent video layer stream 132for transmission as the at least one separate video stream 142 when thedevice resolution corresponds to a first resolution. In addition, thecontrol module 248 can choose the independent video layer stream 122 andeach of the at least one dependent video layer streams 134 fortransmission as the at least one separate video stream 142 when thedevice resolution corresponds to a second resolution that is higher thanthe first resolution.

In a further example, the device parameter 146 can include a power stateof the remote device. The control module can choose the independentvideo layer stream 132 for transmission as the at least one separatevideo stream 142 when the power state corresponds to a first powerstate, such as a low power state. Further, the control module 148 canchoose the independent video layer stream 132 and each of the at leastone dependent video layer streams 134 for transmission as the at leastone separate video stream 142 when the power state corresponds to asecond power state that is higher than the first power state.

Video module 125 can be implemented in hardware, software or firmware.In particular embodiments, the video module 125 can be implemented usingone or more microprocessors, micro-controllers, digital signalprocessors, microcomputers, central processing units, field programmablegate arrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatessignals (analog and/or digital) based on operational instructions thatare stored in a memory module. When video module 125 is implemented withtwo or more devices, each device can perform the same steps, processesor functions in order to provide fault tolerance or redundancy.Alternatively, the function, steps and processes performed by videomodule 125 can be split between different devices to provide greatercomputational speed and/or efficiency. The associated memory module maybe a single memory device or a plurality of memory devices. Such amemory device may be a read-only memory, random access memory, volatilememory, non-volatile memory, static random access memory (SRAM), dynamicrandom access memory (DRAM), flash memory, cache memory, and/or anydevice that stores digital information. Note that when the video module125 implements one or more of its functions via a state machine, analogcircuitry, digital circuitry, and/or logic circuitry, the memory modulestoring the corresponding operational instructions may be embeddedwithin, or external to, the circuitry comprising the state machine,analog circuitry, digital circuitry, and/or logic circuitry

FIG. 10 presents a block diagram representation of a video processingsystem 125″ in accordance with an embodiment of the present invention.Video processing system includes several similar elements to the systemof FIG. 9 that are referred to by common reference numerals. In thisembodiment of the present invention, video transcoder 126 operates basedon channel characteristics 144 and/or device parameter 146 to generate asingle transcoded video signal 140 that is based on the characteristicsand/or state of the mobile vide device 110 or video device 112. Inparticular, video transcoder 126, like video module 125, can pass theindependent video layer stream 132 alone as transcoded video signal 140.In addition, video transcoder module 126 can synchronize and combine theindependent video layer stream 132 with one or more of the dependentvideo layer streams 134 to form transcoded video signal 140. Incircumstances where the final resolution, color scale, frame rate,digital format, et cetera. of the mobile video device 110 or videodevice 112, either based on the current state of the device or based onthe characteristics of the device, differ from each of the possibleresolutions, scales, frame rates available by combinations of thedifferent dependent video layer streams 134, video transcoder 126 cangenerate at least a portion of the video signal by a transcoding tomatch the desired color scale, resolution, frame rate digital format, etcetera of the mobile video device 110 or video device 112 or to adapt toits current state, such as its current power state.

In an embodiment of the present invention, video transcoder 126 receivesindependent video layer stream 132 and one or more dependent video layerstreams 134. The video transcoder 126 generates a transcoded videosignal 140 based the independent video stream alone and optionallyincluding one or more of the dependent video layer streams 134.Transcoder 126 can perform a course level of transcoding by choosingfrom which of the video layer streams to synchronize and combine. Atranscoded video signal 140 can be produced with full, partially reducedor fully reduced scale, resolution, frame rate, motion vectorresolution, color, et cetera. based on the selection of which if any ofthe dependent video layer streams 134 to synchronize and combine withthe independent video layer stream 132.

Video transcoder 126 synchronizes the independent video layer stream 132and the chosen ones of the dependent video layer streams 134 to form asingle synchronized stream and combines the synchronized stream togenerate the transcoded video signal 140. Optionally, the videotranscoder 140 can perform additional fine transcoding by furthertranscoding (such as by decoding and re-encoding the combined videosignal) to a particular frame rate, resolution, color scale, et ceteraor to match a different digital format. In this fashion, whenindependent video layer stream 132 has been encoded in one digitalformat, such as an MPEG-2 format, transcoded video signal 140 can betranscoded into another digital format such as an H.264 format and/orcan be modified in terms of frame rate, resolution, color scale, etcetera based on which, if any, of the dependent video layer streams 134are included in the transcoding and also with optionally additional finetranscoding to produce a frame rate, resolution, color scale, et ceterathat was not otherwise available based on the any combinations of thedependent layer video streams 134.

For example, in one mode of operation, the video transcoder 126synchronizes and combines the independent video layer stream 132 and onedependent video layer stream 134 to generate the transcoded video signal140. In a second mode of operation, the video transcoder 126synchronizes and combines the independent video layer stream 132 and onedependent video layer stream 134 to form a synchronized video signal andfurther transcodes the synchronized video signal to generate thetranscoded video signal 140. In another mode of operation, the videotranscoder 126 generates the transcoded video signal 140 from theindependent video layer stream 132 without any of the dependent videolayer streams 134. In a further mode of operation, the video transcoder126 generates the transcoded video signal 140 by transcoding theindependent video layer stream 132. These examples are merelyillustrative of the many combinations of transcoding possible by videotranscoder 126 in accordance with the present invention.

Video transcoder 126 can be implemented in hardware, software orfirmware. In particular embodiments, the video transcoder 126 can beimplemented using one or more microprocessors, micro-controllers,digital signal processors, microcomputers, central processing units,field programmable gate arrays, programmable logic devices, statemachines, logic circuits, analog circuits, digital circuits, and/or anydevices that manipulates signals (analog and/or digital) based onoperational instructions that are stored in a memory module. When videotranscoder 126 is implemented with two or more devices, each device canperform the same steps, processes or functions in order to provide faulttolerance or redundancy. Alternatively, the function, steps andprocesses performed by video transcoder 126 can be split betweendifferent devices to provide greater computational speed and/orefficiency. The associated memory module may be a single memory deviceor a plurality of memory devices. Such a memory device may be aread-only memory, random access memory, volatile memory, non-volatilememory, static random access memory (SRAM), dynamic random access memory(DRAM), flash memory, cache memory, and/or any device that storesdigital information. Note that when the video transcoder 126 implementsone or more of its functions via a state machine, analog circuitry,digital circuitry, and/or logic circuitry, the memory module storing thecorresponding operational instructions may be embedded within, orexternal to, the circuitry comprising the state machine, analogcircuitry, digital circuitry, and/or logic circuitry

FIG. 11 presents a block diagram representation of a mobile video device110/video device 112 in accordance with an embodiment of the presentinvention. In particular, a mobile video device 110 or 112 is shown thatincludes similar elements discussed in conjunction with FIG. 3. However,in this embodiment, the transceiver module 130 transmits deviceparameter 146 from control unit 140 and/or locally generated channelcharacteristics 144 from channel module 148 to enable wireless accessdevice 104, such as a base station or access point, to transmit an RFsignal containing either a transcoded video signal 140 or one or moreseparate video layer streams that have been adjusted based on thecharacteristics and/or state of the mobile video device 110 or 112.

In an embodiment where transceiver module 130 receives an RF signalcontaining transcoded video signal 140 that is generated to match theformat expected by mobile video device 110/video device 112, videodecoder 152 can include a standard video decoder that decodes thetranscoded video signal 140 to generate decoded video signal 154.Alternatively, where mobile video device 110/video device 112 expectsthat it can received a transcoded signal 140 that has been adapted tothe channel characteristics or based on its own device state, forinstance, video decoder 152, is capable of decoding transcoded videosignal 140 in various formats. In a particular embodiment, thetranscoded video signal 140 is generated by video transcoder 126 toinclude one or more control bits that identify the particular videoformat, frame rate, color scale, and/or resolution, et cetera so thatthe transcoded video signal 140 can be correctly decoded. In analternative embodiment, video decoder 152 receives device parameter 146and/or channel characteristics 144 and determines a particular decodingmode, based on this input.

In a further embodiment of the present invention, the video decoderreceives separate video layer stream 142 that, based on thecharacteristics of the mobile video device 110 or video device 112 beonly a single layer, the independent video layer stream 132. In thiscase, a standard video decoder can be employed. However, to the extentthat the one or more separate video layer stream 142 includesindependent video layer stream 132 and also one or more dependent videolayer streams 134, video decoder operates as video decoder 136 to createa single decoded video signal 138, 138′ or 138″ from the one or moreseparate video layer streams 142.

Video decoder 152 can be implemented in hardware, software or firmware.In particular embodiments, the video decoder 152 can be implementedusing one or more microprocessors, micro-controllers, digital signalprocessors, microcomputers, central processing units, field programmablegate arrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatessignals (analog and/or digital) based on operational instructions thatare stored in a memory module. When video decoder 152 is implementedwith two or more devices, each device can perform the same steps,processes or functions in order to provide fault tolerance orredundancy. Alternatively, the function, steps and processes performedby video decoder 152 can be split between different devices to providegreater computational speed and/or efficiency. The associated memorymodule may be a single memory device or a plurality of memory devices.Such a memory device may be a read-only memory, random access memory,volatile memory, non-volatile memory, static random access memory(SRAM), dynamic random access memory (DRAM), flash memory, cache memory,and/or any device that stores digital information. Note that when thevideo decoder 152 implements one or more of its functions via a statemachine, analog circuitry, digital circuitry, and/or logic circuitry,the memory module storing the corresponding operational instructions maybe embedded within, or external to, the circuitry comprising the statemachine, analog circuitry, digital circuitry, and/or logic circuitry.

FIG. 12 presents a block diagram representation of a scrambling module160 in accordance with an embodiment of the present invention. Inparticular, a scrambling module 160 is shown in conjunction with videoencoder 120 that has been previously discussed, that can be used inconjunction with video encoder 120 in implementations where thescrambling of video signals is desirable for digital rights management,security or other reasons. Scrambling module 160 scrambles theindependent video layer stream 132 to produce a scrambled independentvideo layer stream 162 and leaves the one or more dependent video layerstreams 134 unscrambled. Since the dependent video layer streams 134cannot be meaningfully decoded without reference to the independentvideo layer stream 132 from which they depend, these additional videostreams need not be scrambled. Scrambling only the independent videolayer stream 132 saves on computation, and reduces the complexity ofimplementation of video processing system 125, 125′, 125″, et cetera. Inaddition, by encrypting only one layer, a system can increase thefrequency that keys are updated and/or apply greater key buffering tocreate a more robust design.

In an embodiment of the present invention, scrambling module 160operates by encrypting the independent video layer stream 132 using anencryption algorithm such as a key-based encryption algorithm; however,other scrambling and/or encryption techniques can likewise be used inaccordance with the present invention.

Scrambling module 160 can be implemented in hardware, software orfirmware. In particular embodiments, the scrambling module 160 can beimplemented using one or more microprocessors, micro-controllers,digital signal processors, microcomputers, central processing units,field programmable gate arrays, programmable logic devices, statemachines, logic circuits, analog circuits, digital circuits, and/or anydevices that manipulates signals (analog and/or digital) based onoperational instructions that are stored in a memory module. Whenscrambling module 160 is implemented with two or more devices, eachdevice can perform the same steps, processes or functions in order toprovide fault tolerance or redundancy. Alternatively, the function,steps and processes performed by scrambling module 160 can be splitbetween different devices to provide greater computational speed and/orefficiency. The associated memory module may be a single memory deviceor a plurality of memory devices. Such a memory device may be aread-only memory, random access memory, volatile memory, non-volatilememory, static random access memory (SRAM), dynamic random access memory(DRAM), flash memory, cache memory, and/or any device that storesdigital information. Note that when the scrambling module 160 implementsone or more of its functions via a state machine, analog circuitry,digital circuitry, and/or logic circuitry, the memory module storing thecorresponding operational instructions may be embedded within, orexternal to, the circuitry comprising the state machine, analogcircuitry, digital circuitry, and/or logic circuitry.

FIG. 13 presents a block diagram representation of a descrambling module164 in accordance with an embodiment of the present invention. Inparticular, descrambling module 164 is coupled to receive the scrambledindependent video layer stream 162 and operates to descramble thescrambled independent video layer stream 162, based on the particularscrambling technique employed, to produce a descrambled independentvideo layer stream 166. Video decoder 136 operates on the descrambledindependent video layer stream 166 as if it were the originalindependent video layer stream 132, and operates as previously discussedto generate a reconstructed video signal such as decoded video signal138, 138′, 138″, et cetera.

Descrambling module 164 can be implemented in hardware, software orfirmware. In particular embodiments, the descrambling module 164 can beimplemented using one or more microprocessors, micro-controllers,digital signal processors, microcomputers, central processing units,field programmable gate arrays, programmable logic devices, statemachines, logic circuits, analog circuits, digital circuits, and/or anydevices that manipulates signals (analog and/or digital) based onoperational instructions that are stored in a memory module. Whendescrambling module 164 is implemented with two or more devices, eachdevice can perform the same steps, processes or functions in order toprovide fault tolerance or redundancy. Alternatively, the function,steps and processes performed by descrambling module 164 can be splitbetween different devices to provide greater computational speed and/orefficiency. The associated memory module may be a single memory deviceor a plurality of memory devices. Such a memory device may be aread-only memory, random access memory, volatile memory, non-volatilememory, static random access memory (SRAM), dynamic random access memory(DRAM), flash memory, cache memory, and/or any device that storesdigital information. Note that when the descrambling module 164implements one or more of its functions via a state machine, analogcircuitry, digital circuitry, and/or logic circuitry, the memory modulestoring the corresponding operational instructions may be embeddedwithin, or external to, the circuitry comprising the state machine,analog circuitry, digital circuitry, and/or logic circuitry.

While the systems of FIGS. 12 and 13 have been described in terms of thescrambling of the independent video layer stream 132 while dependentvideo layer streams 134 are left unscrambled, in an alternativeembodiment, the scrambling of layers can be reversed and the independentvideo layer stream 132 can be unscrambled and one or all of thedependent video layer streams 134 can be scrambled. This embodiment,among other possible uses, can be used in a system whereby theindependent video layer stream 132 is a low resolution signal that istransmitted without restriction, but users require the encryption keysto access the dependent video layer streams that provide enhancedresolution decoding and display. In this fashion, the low resolutionsignal can be provided on a free basis, while access to greaterresolution is provided on a subscription of other fee-basis.

FIG. 14 presents a block diagram representation of a video processingsystem 125′″ in accordance with an embodiment of the present invention.In particular, video processing system 125′″ includes a video encoder170 that encodes a video signal 118 into a contiguous video stream 172having an independent portion and a dependent portion that requires theindependent portion for decoding

Scrambling module 174 scrambles the contiguous video stream 172 toproduce a scrambled video stream 176 by scrambling the independent videoportion and leaving the dependent portion unscrambled. For example,video encoder 170 can encode frames of video signal 118 into I frames,P, frames and B frames, wherein the independent portion of thecontiguous video stream 172 includes the I frames and the dependentportion of the contiguous video stream 172 includes the B frames and theP frames. Since the P and B frames require data from the I frames fordecoding, scrambling, such as by encrypting, a portion of the contiguousvideo stream 172 that includes the I frames means that the contiguousvideo stream 172 cannot be meaningfully decoded without being able todescramble the scrambled data. In an embodiment of the presentinvention, video encoder 170 implements MPEG-2 video compression,however other encoding techniques that utilize I, P and B frames orsimilar techniques or that otherwise employ other independent anddependent portions can similarly be scrambled in this fashion inaccordance with the present invention to save computation effort inscrambling and descrambling.

In an embodiment of the present invention, the scrambled independentportion of the scrambled video stream 176 includes digital rightsmanagement (DRM) data that is scrambled to protect the integrity of thisDRM data.

Video encoder 170 and scrambling module 174 can be implemented inhardware, software or firmware. In particular embodiments, the videoencoder 170 and scrambling module 174 can be implemented using one ormore microprocessors, micro-controllers, digital signal processors,microcomputers, central processing units, field programmable gatearrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatessignals (analog and/or digital) based on operational instructions thatare stored in a memory module. When video encoder 170 and scramblingmodule 174 is implemented with two or more devices, each device canperform the same steps, processes or functions in order to provide faulttolerance or redundancy. Alternatively, the function, steps andprocesses performed by video encoder 170 and scrambling module 174 canbe split between different devices to provide greater computationalspeed and/or efficiency. The associated memory module may be a singlememory device or a plurality of memory devices. Such a memory device maybe a read-only memory, random access memory, volatile memory,non-volatile memory, static random access memory (SRAM), dynamic randomaccess memory (DRAM), flash memory, cache memory, and/or any device thatstores digital information. Note that when the video encoder 170 andscrambling module 174 implements one or more of its functions via astate machine, analog circuitry, digital circuitry, and/or logiccircuitry, the memory module storing the corresponding operationalinstructions may be embedded within, or external to, the circuitrycomprising the state machine, analog circuitry, digital circuitry,and/or logic circuitry.

FIG. 15 presents a pictorial representation of a scrambled independentvideo stream 176 in accordance with an embodiment of the presentinvention. In particular an example of scrambled independent videostream 176 is shown with scrambled independent portions 180 and 184 andunscrambled dependent portions 182 and 186. In an embodiment of thepresent invention, the independent and dependent portions areinterlaced, however, the dependent and independent portions can becombined to form the scrambled independent video stream in other ways.

FIG. 16 presents a block diagram representation of a video processingsystem 125′″ in accordance with another embodiment of the presentinvention. In particular, a further embodiment of video processingsystem 125′″ that includes a descrambling module 190 coupled to receivethe scrambled video stream 176 and to produce a descrambled video stream192 by descrambling the scrambled independent portion. In this fashion,the descrambled video stream can be decoded, via a convention videodecoder 194 to produce a decoded video signal 196.

Descrambling module 190 can be implemented in hardware, software orfirmware. In particular embodiments, the descrambling module 190 can beimplemented using one or more microprocessors, micro-controllers,digital signal processors, microcomputers, central processing units,field programmable gate arrays, programmable logic devices, statemachines, logic circuits, analog circuits, digital circuits, and/or anydevices that manipulates signals (analog and/or digital) based onoperational instructions that are stored in a memory module. Whendescrambling module 190 is implemented with two or more devices, eachdevice can perform the same steps, processes or functions in order toprovide fault tolerance or redundancy. Alternatively, the function,steps and processes performed by descrambling module 190 can be splitbetween different devices to provide greater computational speed and/orefficiency. The associated memory module may be a single memory deviceor a plurality of memory devices. Such a memory device may be aread-only memory, random access memory, volatile memory, non-volatilememory, static random access memory (SRAM), dynamic random access memory(DRAM), flash memory, cache memory, and/or any device that storesdigital information. Note that when the descrambling module 190implements one or more of its functions via a state machine, analogcircuitry, digital circuitry, and/or logic circuitry, the memory modulestoring the corresponding operational instructions may be embeddedwithin, or external to, the circuitry comprising the state machine,analog circuitry, digital circuitry, and/or logic circuitry.

FIG. 17 presents a pictorial representation of a descrambling of ascrambled video stream in accordance with an embodiment of the presentinvention. In particular, a descrambling module such as descramblingmodule 190 separates the scrambled independent portions 180, 184, . . .of the scrambled video stream 176 from the unscrambled independentportions 182, 186, . . . The descrambling module produces descrambledindependent portions 180′, 184′, . . . from the scrambled independentportions 180, 184, . . . , and produces the descrambled video stream 192by synchronizing the descrambled independent portions 180′, 184′, . . .with the unscrambled dependent portions 182, 186, . . .

FIG. 18 presents a block diagram representation of a mobile video device110/video device 112 in accordance with an embodiment of the presentinvention. In particular a video processing device such as mobile videodevice 110 or video device 112 includes a user interface module 206 suchas a touch screen, remote control device, mouse, thumb wheel, keypad orother interface that receives one or more user preferences. The videoprocessing device includes a transceiver module 130 that receives an RFsignal containing a basic video layer stream 200 and one or moregraphics layer streams 202. A decoder module, such as video decoder 208produces a decoded video signal 210 for video display device 140 from abasic video layer stream 200 and at least one graphics layer streams 202recovered by the transceiver module 130, based on the at least one userpreference 204.

In an embodiment of the present invention, the one or more graphicslayer streams 202 includes data in accordance with a plurality ofpresentation options such as graphics overlays, interactive ornon-interactive that can be combined with the basic video layer stream200 to enhance the user experience. The user preferences 204 select atleast one of the plurality of presentation options, and wherein thevideo decoder 208 applies the presentation options in the decoded videosignal 210.

For example, a basic video layer stream 200 from a weather channel caninclude the basic video programming from that channel. In addition, thebasic video layer stream 200 is transmitted with one or more additionalgraphics video layers 202 that contain, for instance, additional weatherinformation such as local temperature, local forecast data that canoptionally be displayed in different formats based on the selectedpresentation option. Further, the one or more graphics video layers 202can include non-weather related data such as sports scores, financialdata such as real-time or near real-time stock process, or otherfinancial news or other breaking news information. This data can beoptionally selected for display and be displayed in a selected format,font, color scheme or portion of the display screen based on the userpreferences 204.

In an embodiment of the present invention, the basic video layer stream200 and at least one graphics layer streams correspond to a videoprogram such as a movie, or television program. The video decoder 208stores the user preferences 204 when the video program is decoded afirst time and applies the presentation options when the video programis decoded a second time, subsequent to the first time. In this fashion,one a set of user preferences 204 have been selected for a particularvideo program, the presentation options associated with these userpreferences 204 can be applied each time the particular video program isviewed, unless cancelled or deleted.

Further the user preferences 204 can optionally be applied to selectpresentation options when another video program is decoded that has oneor more of the same presentation options. For instance, if the userselects to run sports scores in the top right corner of his screen whenwatching a football game. If a basketball game is transmitted with agraphics video layer that includes this presentation option, the videodecoder 208 can automatically apply these options, based on the storeduser preferences 204, unless and until cancelled or erased by the user.

Similarly the user may elect to turn off all graphics layers, turn onall graphics layers, for instance adding sports scores, weather, newsand program specific graphics to each viewed program, based on theselection of particular user preferences 204. For instance, videodecoder 208 can produce the decoded video signal 210 from the basicvideo layer stream 200 and not any of the graphics layer streams 202when the user preferences 204 includes a first data value. Further,video decoder 208 can produce the decoded video signal 210 from thebasic video layer stream 200 and any or all of the graphics layerstreams 202 when the user preferences 204 includes a second data value.

In operation, the video decoder 208 synchronizes and combines the basicvideo layer stream 200 and one or more graphics layer streams 204 anddecodes the synchronized stream to for decoded video signal 210. Itshould be noted that the user interface module 206 can receive the userpreferences 204 during a set-up of the video processing device or duringthe production of the decoded video signal 210 that contains aparticular basic video layer stream 200 and one or more graphics layerstreams 202 for which the user preferences are desired to be applied.

It should be noted that basic video layer stream 200 and one or moregraphics layer streams 202 provide additional examples of independentvideo layer stream 132 and one or more dependent video layer streams 134and the many functions and features of the present invention describedin conjunction with FIGS. 1-18 could likewise be applied to thisadditional video layering technique.

Video decoder 208 can be implemented in hardware, software or firmware.In particular embodiments, the video decoder 208 can be implementedusing one or more microprocessors, micro-controllers, digital signalprocessors, microcomputers, central processing units, field programmablegate arrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatessignals (analog and/or digital) based on operational instructions thatare stored in a memory module. When video decoder 208 is implementedwith two or more devices, each device can perform the same steps,processes or functions in order to provide fault tolerance orredundancy. Alternatively, the function, steps and processes performedby video decoder 208 can be split between different devices to providegreater computational speed and/or efficiency. The associated memorymodule may be a single memory device or a plurality of memory devices.Such a memory device may be a read-only memory, random access memory,volatile memory, non-volatile memory, static random access memory(SRAM), dynamic random access memory (DRAM), flash memory, cache memory,and/or any device that stores digital information. Note that when thevideo decoder 208 implements one or more of its functions via a statemachine, analog circuitry, digital circuitry, and/or logic circuitry,the memory module storing the corresponding operational instructions maybe embedded within, or external to, the circuitry comprising the statemachine, analog circuitry, digital circuitry, and/or logic circuitry.

FIG. 19 presents a pictorial representation of graphics displays inaccordance with an embodiment of the present invention. In particular,basic video display 220 presents an example display from mobile videodevice 110/video device 112 resulting from the decoding of a basic videolayer stream 200. Basic video with enhanced graphics overlay 222 is anexample display resulting from the decoding of the same basic videolayer stream 200 along with a graphics layer stream containing aplurality of presentation options for displaying weather information,such as temperature. In this example 222, the user has set userpreferences 204 to display the current temperature at the bottom of thedisplay screen in a banner portion in degrees Celsius, either during aninitial set-up of the mobile video device 110/video device 112 or due toa default setting of user preferences 204. In an embodiment of thepresent invention, this presentation option is applied whenever thisparticular video program or channel is viewed by the user of mobilevideo device 110/video device 112. In addition, this, this presentationoption is applied whenever another video program or channel is viewed bythe user of mobile video device 110/video device 112 that contains thispresentation option in an accompanying graphics layer stream.

FIG. 20 presents another pictorial representation of a graphics displayin accordance with an embodiment of the present invention. Inparticular, basic video with enhanced graphics overlay 222′ is anexample display resulting from the decoding of the same basic videolayer stream 200 along with a graphics layer stream containing aplurality of presentation options for displaying weather informationsuch as temperature. In this example 222′, the user has set userpreferences 204 to display the current temperature (or modify thedisplay of the current temperature) at the bottom of the display screenin a banner portion in degrees Fahrenheit, during the display of thebasic video 220. One or more graphics layer streams 202 optionallycontain various banner configurations and data in various formats thatcan be selected for decoding. In this case, local temperature data inboth degrees C. and degrees F. is included in the one or more graphicslayer streams 202 for selection by the user.

As in the example presented in conjunction with FIG. 19, thispresentation option is applied whenever this particular video program orchannel is viewed by the user of mobile video device 110/video device112. In addition, this presentation option is applied whenever anothervideo program or channel is viewed by the user of mobile video device110/video device 112 that contains this presentation option in anaccompanying graphics layer stream.

FIG. 21 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-20. In step 400, a video stream is encoded into a independentvideo layer stream and a first dependent video layer stream based on aplurality of motion vectors, wherein the independent video layer streamincludes a first plurality of motion vector data corresponding to theplurality of motion vectors, the first plurality of motion vector datarepresenting a plurality of most significant bits of each of theplurality of motion vectors, wherein the first dependent video layerstream includes a second plurality of motion vector data correspondingto the plurality of motion vectors, the second plurality of motionvector data representing a plurality of least significant bits of eachof the plurality of motion vectors, and wherein the first dependentvideo layer stream does not include the first plurality of motion vectordata.

In an embodiment of the present invention, the first plurality of motionvector data includes an integer portion for each of the plurality ofmotion vectors and the second plurality of motion vector data includes afractional portion for each of the plurality of motion vectors. Decodingof the first dependent video layer stream can be dependent on data fromthe independent video layer stream. Step 400 further encode the videostream into a second dependent video layer stream, wherein the seconddependent video layer stream includes a third plurality of motion vectordata corresponding to the plurality of motion vectors, and wherein thesecond dependent video layer stream does not include the first pluralityof motion vector data and does not include the second plurality ofmotion vector data.

FIG. 22 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-21. In step 405, a video stream is encoded into a independentvideo layer stream and a first dependent video layer stream, wherein theindependent video layer stream includes a plurality of grayscale data,wherein the first dependent video layer stream includes a plurality ofcolor data, and wherein the first dependent video layer stream does notinclude the plurality of grayscale data.

In an embodiment of the present invention, the independent video layerstream does not include the plurality of color data. Decoding of thefirst dependent video layer stream can be dependent on data from theindependent video layer stream. The grayscale data can include luma dataand the color data can include chroma data.

FIG. 23 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-22. In step 410 the method determines if a device or method isin a first or second mode of operation. When in a first mode ofoperation, the method proceeds to step 412 of receiving the independentvideo layer stream and the first dependent video layer stream. In step414, the independent video layer stream and the first dependent videolayer stream are synchronized to form a synchronized stream. In step416, a reconstructed video signal is generated based on the synchronizedstream.

When in a second mode of operation, the method proceeds to step 422 ofreceiving the independent video layer stream. In step 426, areconstructed video signal is generated based on the independent videolayer stream, without the first dependent video layer stream.

FIG. 24 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-23. Step 420 includes receiving an independent video layerstream and at least one dependent video layer streams that require theindependent video layer for decoding. In step 422, a decoded videosignal is generated from at least one separate video stream chosen,based on the device parameter, from the independent video layer streamand at least one dependent video layer streams.

In an embodiment of the present invention, the device parameter includesa device resolution. The at least one separate video layer stream can bechosen as the at least one separate video stream when the deviceresolution corresponds to a first resolution. The at least one separatevideo layer stream and each of the at least one dependent video layerstreams can be chosen as the at least one separate video stream when thedevice resolution corresponds to a second resolution that is higher thanthe first resolution.

Further, the device parameter can include a power state of the remotedevice choosing the at least one separate video layer stream can choosethe independent video layer stream as the at least one separate videostream when the power states corresponds to a first power state. Inaddition, choosing the at least one separate video layer stream canchoose the independent video layer stream and each of the at least onedependent video layer streams as the at least one separate video streamwhen the power states corresponds to a second power state that is higherthan the first power state. Also, step 422 can include synchronizing theindependent video layer stream and at least one dependent video layerstreams.

FIG. 25 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-24. In step 430, a video signal is transmitted to a remotedevice over at least one RF communications channel wherein the videosignal is transmitted as at least one separate video layer stream chosenfrom, an independent video layer stream and at least one dependent videolayer streams that require the independent video layer for decoding. Instep 432, at least one channel characteristic of the at least one RFchannel is determined. In step 434 the at least one separate video layerstream is chosen based on the at least one channel characteristic of theat least one RF channel.

In an embodiment of the present invention choosing the at least oneseparate video layer stream includes choosing the independent videolayer stream as the at least one separate video stream when the at leastone channel characteristic compares unfavorably to a threshold. Further,choosing the at least one separate video layer stream can includechoosing the independent video layer stream and each of the at least onedependent video layer streams as the at least one separate video streamwhen the at least one channel characteristic compares favorably to athreshold. Also, the least one channel characteristic can include asignal to noise ratio, a received signal strength, a bit error rate, apacket retransmission rate, a reception parameter received from theremote device.

FIG. 26 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-25. In step 440, transmission parameters are selected based onthe at least one channel characteristic, wherein transmitting the videosignal includes transmitting the video signal based on the selectedtransmission parameters.

In an embodiment of the present invention, the transmission parametersinclude modulation spectral densities, a data rate and/or a forwarderror correction code. The at least one separate video layer stream canincludes the independent video layer stream, wherein the at least one RFchannel includes a plurality of multi-input multi-output (MIMO)channels, and wherein the transmission parameters include a selectedsubset of the plurality of MIMO channels used to transmit theindependent video layer stream. Step 440 can include selecting thetransmission parameters further based on the at least one separate videolayer stream that was chosen.

FIG. 27 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-26. In step 450, a device parameter is received from a remotedevice. In step 452, a video signal is transmitted to the remote device,wherein the video signal is transmitted as at least one separate videolayer stream chosen from, an independent video layer stream and at leastone dependent video layer streams that require the independent videolayer for decoding. In step 454, the at least one separate video layerstream is chosen based on the device parameter.

In an embodiment of the present invention, the device parameter includesa device resolution. Step 454 can choose the independent video layerstream as the at least one separate video stream when the deviceresolution corresponds to a first resolution. Step 454 can choose theindependent video layer stream and each of the at least one dependentvideo layer streams as the at least one separate video stream when thedevice resolution corresponds to a second resolution that is higher thanthe first resolution.

In an embodiment of the present invention, the device parameter includesa power state of the remote device. Step 454 can choose the independentvideo layer stream as the at least one separate video stream when thepower states corresponds to a first power state. Step 454 can choose theindependent video layer stream and each of the at least one dependentvideo layer streams as the at least one separate video stream when thepower states corresponds to a second power state that is higher than thefirst power state.

FIG. 28 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-27. In step 460, at least a portion of the video signal isgenerated by a transcoding that is based on the device parameter.

FIG. 29 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-28. In step 470, a device parameter is transmitted to a remotedevice. In step 472, a video signal is received from the remote deviceover at least one RF communications channel, wherein the video signal istransmitted as at least one separate video layer stream, chosen based onthe device parameter from, an independent video layer stream and atleast one dependent video layer streams that require the independentvideo layer for decoding.

In an embodiment of the present invention, the device parameter includesa device resolution and/or a power state of the remote device.

FIG. 30 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-29. Step 480 includes receiving an independent video layerstream and a first dependent video layer stream that requires theindependent video layer for decoding. In step 482, a transcoded videosignal is generated based at least one of the independent video streamand the dependent video layer stream.

In an embodiment of the present invention, in a first mode of operation,step 482 includes synchronizing and combining the independent videolayer stream and the first dependent video layer stream to generate thetranscoded video signal. In a second mode of operation, step 482includes synchronizing and combining the independent video layer streamand the first dependent video layer stream to form a synchronized videosignal and further includes transcoding the synchronized video signal togenerate the transcoded video signal. Also, in another mode ofoperation, step 482 can generate the transcoded video signal from theindependent video layer stream without the dependent video layer stream.In a third mode of operation, step 482 generates the transcoded videosignal by transcoding the independent video layer stream.

The independent video layer stream can include a first plurality ofmotion vector data corresponding to a plurality of motion vectors, thefirst plurality of motion vector data representing a plurality of mostsignificant bits of each of the plurality of motion vectors, wherein thefirst dependent video layer stream can include a second plurality ofmotion vector data corresponding to the plurality of motion vectors, thesecond plurality of motion vector data representing a plurality of leastsignificant bits of each of the plurality of motion vectors, and whereinthe second video layer stream does not include the first plurality ofmotion vector data.

The independent video layer stream can includes a plurality of grayscaledata, wherein the first dependent video layer stream includes aplurality of color data, and wherein the second video layer stream doesnot include the plurality of grayscale data.

FIG. 31 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-30 and in particular with the method of FIG. 30. In step 490, asecond dependent video layer stream is received, and step 482 is furtherbased on the second dependent video layer stream.

FIG. 32 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-31. In step 500, a video stream is encoded into a independentvideo layer stream and a first dependent video layer stream thatrequires the independent video layer for decoding. In step 502, theindependent video layer stream is scrambled to produce a scrambledindependent video layer stream while leaving the first dependent videolayer stream unscrambled.

In an embodiment of the present invention step 502 includes encryptingthe independent video layer stream. Step 500 can further includeencoding the video stream into a second dependent video layer stream,and wherein scrambling the independent video layer stream further leavesthe second dependent video layer stream unscrambled. The independentvideo layer stream can include a first plurality of motion vector datacorresponding to a plurality of motion vectors, the first plurality ofmotion vector data representing a plurality of most significant bits ofeach of the plurality of motion vectors, wherein the first dependentvideo layer stream includes a second plurality of motion vector datacorresponding to the plurality of motion vectors, the second pluralityof motion vector data representing a plurality of least significant bitsof each of the plurality of motion vectors, and wherein the second videolayer stream does not include the first plurality of motion vector data.

The independent video layer stream can include a plurality of grayscaledata, wherein the first dependent video layer stream includes aplurality of color data, and wherein the second video layer stream doesnot include the plurality of grayscale data.

FIG. 33 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-32 and particularly with the method of FIG. 32. In step 510, thescrambled independent video layer stream is received. In step 512, thescrambled independent video layer stream is descrambled to produce adescrambled independent video layer stream.

FIG. 34 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-32 and particularly with the methods of FIGS. 32-33. In step520, the method determines if the method or device is operating in afirst or second mode of operation. In a first mode of operation, themethod proceeds to step 522 of receiving the descrambled independentvideo layer stream and the first dependent video layer stream. In step524, the descrambled independent video layer stream and the firstdependent video layer stream are synchronized to form a synchronizedstream. In step 526, a reconstructed video signal is generated based onthe synchronized stream.

In a second mode of operation, the method proceeds to step 532 ofreceiving the descrambled independent video layer stream. In step 536, areconstructed video signal is generated based on the descrambledindependent layer stream, without the first dependent video layerstream.

FIG. 35 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-34. In step 540, a video signal is encoded into a contiguousvideo stream having an independent portion and a dependent portion thatrequires the independent portion for decoding. In step 542, thecontiguous video stream is scrambled to produce a scrambled video streamby scrambling the independent video portion and leaving the dependentportion unscrambled.

In an embodiment of the present invention, step 542 includes encryptingthe independent portion. The independent portion can include a pluralityof I frames of the contiguous video stream and/or digital rightsmanagement data of the contiguous video stream. The dependent portioncan includes a plurality of B frames of the contiguous video streamand/or a plurality of P frames of the contiguous video stream.

FIG. 36 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-35 and particularly the method of claim 35. In step 550, adescrambled video stream is generated by descrambling the scrambledindependent portion. Step 550 can include separating the scrambledindependent portion of the scrambled video stream, producing adescrambled independent portion from the scrambled independent portion,and producing the descrambled video stream by synchronizing thedescrambled independent portion with the dependent portion.

FIG. 37 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-36. In step 560, at least one user preference is received. Instep 562, a decoded video signal is generated from a basic video layerstream and at least one graphics layer streams based on the at least oneuser preference.

In an embodiment of the present invention the at least one graphicslayer streams includes data in accordance with a plurality ofpresentation options, wherein the at least one user preference selectsat least one of the plurality of presentation options, and whereingenerating the decoded video signal includes applying the presentationoptions in the decoded video signal. The basic video layer stream and atleast one graphics layer streams can correspond to a video program andwherein generating the decoded video signal includes storing the atleast one user preference when the video program is decoded a first timeand applying the presentation options when the video program is decodeda second time, subsequent to the first time. The basic video layerstream and at least one graphics layer streams can correspond to a firstvideo program and wherein generating the decoded video signal includesstoring the at least one user preference when the first video program isdecoded and applying the presentation options when the a second videoprogram is decoded and wherein the second video program includes the atleast one of the plurality of presentation options.

Step 562 can include producing the decoded video signal from the basicvideo layer stream and not the graphics layer stream when the at leastone user preference includes a first data value. Step 562 can includeproducing the decoded video signal from the basic video layer stream andeach of the at least one graphics layer streams when the at least oneuser preference includes a second data value. Step 562 can includesynchronizing and combining the independent video layer stream and atleast one dependent video layer streams and decoding the combinedstream.

Step 560 can include receiving the at least one user preference from aremote control device during a set-up of the video processing device.The basic video layer stream and at least one graphics layer streamscorrespond to a video program, and step 560 can include receiving the atleast one user preference from a remote control device during productionof the decoded video signal. FIG. 38 is a flowchart representation of amethod in accordance with the present invention. In particular, a methodis presented for use with one or more of the functions and featurespresented in conjunction with FIGS. 1-37. In step 600, a video stream isencoded into an independent video layer stream and a first dependentvideo layer stream, wherein the independent video layer stream includesa first plurality of random access points having a first frequency, andwherein the first dependent video layer stream includes a secondplurality of random access points having a second frequency, and whereinthe first frequency is greater than the second frequency.

FIG. 39 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-38. In step 602, the video stream is further encoded into asecond dependent video layer stream, wherein the second dependent videolayer stream includes a third plurality of random access points having athird frequency, and wherein the first frequency is greater than thethird frequency. In an embodiment of the present invention, the secondfrequency is greater than the third frequency.

FIG. 40 is a flowchart representation of a method in accordance with thepresent invention. In particular, a method is presented for use with oneor more of the functions and features presented in conjunction withFIGS. 1-39. In step 620, the method determines if the invention isoperating in a first or second mode of operation.

In a first mode of operation, the independent video layer stream isreceived in step 632, and decoded based on at least one of the firstplurality of random access points in step 634. In step 636, areconstructed video signal is generated based on the decoded independentvideo layer stream, without the first dependent video layer stream. Inthe second mode of operation, both the independent video layer streamand the first dependent video layer stream are received as shown in step622. In steps 624 and 626, the independent video layer stream is decodedbased on at least one of the first plurality of random access points andthe first dependent video layer stream is decoded based on at least oneof the second plurality of random access points. In step 628, theindependent video layer stream and the first dependent video layerstream are synchronized to form a synchronized stream. In step 630, areconstructed video signal is generated based on the synchronizedstream. In an embodiment of the present invention, step 626 is dependenton data from the independent video layer stream.

As may be used herein, the terms “substantially” and “approximately”provides an industry-accepted tolerance for its corresponding termand/or relativity between items. Such an industry-accepted toleranceranges from less than one percent to fifty percent and corresponds to,but is not limited to, component values, integrated circuit processvariations, temperature variations, rise and fall times, and/or thermalnoise. Such relativity between items ranges from a difference of a fewpercent to magnitude differences. As may also be used herein, theterm(s) “coupled to” and/or “coupling” and/or includes direct couplingbetween items and/or indirect coupling between items via an interveningitem (e.g., an item includes, but is not limited to, a component, anelement, a circuit, and/or a module) where, for indirect coupling, theintervening item does not modify the information of a signal but mayadjust its current level, voltage level, and/or power level. As mayfurther be used herein, inferred coupling (i.e., where one element iscoupled to another element by inference) includes direct and indirectcoupling between two items in the same manner as “coupled to”. As mayeven further be used herein, the term “operable to” indicates that anitem includes one or more of power connections, input(s), output(s), etcetera., to perform one or more its corresponding functions and mayfurther include inferred coupling to one or more other items. As maystill further be used herein, the term “associated with”, includesdirect and/or indirect coupling of separate items and/or one item beingembedded within another item. As may be used herein, the term “comparesfavorably”, indicates that a comparison between two or more items,signals, et cetera, provides a desired relationship. For example, whenthe desired relationship is that signal 1 has a greater magnitude thansignal 2, a favorable comparison may be achieved when the magnitude ofsignal 1 is greater than that of signal 2 or when the magnitude ofsignal 2 is less than that of signal 1.

The present invention has also been described above with the aid ofmethod steps illustrating the performance of specified functions andrelationships thereof. The boundaries and sequence of these functionalbuilding blocks and method steps have been arbitrarily defined hereinfor convenience of description. Alternate boundaries and sequences canbe defined so long as the specified functions and relationships areappropriately performed. Any such alternate boundaries or sequences arethus within the scope and spirit of the claimed invention.

The present invention has been described above with the aid offunctional building blocks illustrating the performance of certainsignificant functions. The boundaries of these functional buildingblocks have been arbitrarily defined for convenience of description.Alternate boundaries could be defined as long as the certain significantfunctions are appropriately performed. Similarly, flow diagram blocksmay also have been arbitrarily defined herein to illustrate certainsignificant functionality. To the extent used, the flow diagram blockboundaries and sequence could have been defined otherwise and stillperform the certain significant functionality. Such alternatedefinitions of both functional building blocks and flow diagram blocksand sequences are thus within the scope and spirit of the claimedinvention. One of average skill in the art will also recognize that thefunctional building blocks, and other illustrative blocks, modules andcomponents herein, can be implemented as illustrated or by discretecomponents, application specific integrated circuits, processorsexecuting appropriate software and the like or any combination thereof.

1. A video processing system comprising: a video encoder that encodes avideo stream into an independent video layer stream and a firstdependent video layer stream, wherein the independent video layer streamincludes a first plurality of random access points having a firstfrequency, and wherein the first dependent video layer stream includes asecond plurality of random access points having a second frequency; avideo decoder that, in a first mode of operation, is coupled to receivethe independent video layer stream, to begin decoding the independentvideo layer stream based on at least one of the first plurality ofrandom access points and to generate a reconstructed video signal basedon the independent video layer stream, without the first dependent videolayer stream; wherein the video decoder, in a second mode of operation,is further coupled to receive the first dependent video layer stream, tobegin decoding the first dependent video layer stream based on at leastone of the second plurality of random access points, to synchronize theindependent video layer stream and the first dependent video layerstream to form a synchronized stream, and to generate a reconstructedvideo signal based on the synchronized stream.
 2. The video processingsystem of claim 1 wherein the first frequency is greater than the secondfrequency.
 3. The video processing system of claim 1, wherein decodingof the first dependent video layer stream is dependent on data from theindependent video layer stream.
 4. The video processing system of claim1 wherein the video encoder further encodes the video stream into asecond dependent video layer stream, and wherein the second dependentvideo layer stream includes a third plurality of random access pointshaving a third frequency, and wherein the first frequency is greaterthan the third frequency.
 5. The video processing system of claim 4wherein the second frequency is greater than the third frequency.
 6. Avideo processing system comprising: a video encoder that encodes a videostream into an independent video layer stream and a first dependentvideo layer stream that includes data that is dependent on data from theindependent video layer stream wherein the independent video layerstream includes a first plurality of random access points having a firstfrequency, and wherein the first dependent video layer stream includes asecond plurality of random access points having a second frequency, andwherein the first frequency is greater than the second frequency; avideo decoder that, in a first mode of operation, is coupled to receivethe independent video layer stream, to begin decoding the independentvideo layer stream based on at least one of the first plurality ofrandom access points and to generate a reconstructed video signal basedon the independent video layer stream, without the first dependent videolayer stream, wherein the video decoder, in a second mode of operation,is further coupled to receive the first dependent video layer stream, tobegin decoding the first dependent video layer stream based on at leastone of the second plurality of random access points, to synchronize theindependent video layer stream and the first dependent video layerstream to form a synchronized stream, and to generate a reconstructedvideo signal based on the synchronized stream.
 7. The video processingsystem of claim 6, wherein decoding of the first dependent video layerstream is dependent on data from the independent video layer stream. 8.The video processing system of claim 6 wherein the video encoder furtherencodes the video stream into a second dependent video layer stream, andwherein the second dependent video layer stream includes a thirdplurality of random access points having a third frequency, and whereinthe first frequency is greater than the third frequency.
 9. The videoprocessing system of claim 8 wherein the second frequency is greaterthan the third frequency.
 10. A method comprising: encoding a videostream into an independent video layer stream and a first dependentvideo layer stream, wherein the independent video layer stream includesa first plurality of random access points having a first frequency, andwherein the first dependent video layer stream includes a secondplurality of random access points having a second frequency, and whereinthe first frequency is greater than the second frequency; receiving theindependent video layer stream; and in a first mode of operation:decoding the independent video layer stream based on at least one of thefirst plurality of random access points; and generating a reconstructedvideo signal based on the decoded independent video layer stream,without the first dependent video layer stream; in a second mode ofoperation: receiving the first dependent video layer stream; decodingthe independent video layer stream based on at least one of the firstplurality of random access points; decoding the first dependent videolayer stream based on at least one of the second plurality of randomaccess points; synchronizing the independent video layer stream and thefirst dependent video layer stream to form a synchronized stream; andgenerating a reconstructed video signal based on the synchronizedstream.
 11. The method of claim 10, wherein decoding of the firstdependent video layer stream is dependent on data from the independentvideo layer stream.
 12. The method of claim 10 further comprising:encoding the video stream into a second dependent video layer stream,wherein the second dependent video layer stream includes a thirdplurality of random access points having a third frequency, and whereinthe first frequency is greater than the third frequency.
 13. The methodof claim 12 wherein the second frequency is greater than the thirdfrequency.